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Abstract 

Consider a multi-input multi-output (MIMO) downlink multi-user channel. A well-studied problem in 
such system is the design of linear beamformers for power minimization with the quality of service (QoS) 
constraints. The most representative algorithms for solving this class of problems are the so-called MMSE- 
SOCP algorithm ifTTll . ifT^ and the UDD algorithm 13 ■ The former is based on alternating optimization 
of the transmit and receive beamformers; while the latter is based on the well-known uplink-dowlink 
duality theory. Despite their wide applicability, the convergence (to KKT solutions) of both algorithms is 
still open in the literature. In this paper, we rigorously establish the convergence of these algorithms for 
QoS-constrained power minimization (QCPM) problem with both single stream and multiple streams per 
user cases. Key to our analysis is the development and analysis of a new MMSE-DUAL algorithm, which 
connects the MMSE-SOCP and the UDD algorithm. Our numerical experiments show that 1) all these 
algorithms can almost always reach points with the same objective value irrespective of initialization; 
2) the MMSE-SOCP/MMSE-DUAL algorithm works well while the UDD algorithm may fail with an 
infeasible initialization. 


I. Introduction 

Multi-user MIMO (MU-MIMO) is a key building block of the next generation wireless communication 
system. In a MU-MIMO downlink system, a base station (BS) equipped with multiple antennas simultane¬ 
ously transmits data to a group of multiple antenna users. The multi-user interference, which is the major 
performance limiting factor of MU-MIMO systems, must be managed intelligently using the physical 
layer techniques such as beamforming. In general, there are two major objectives in the beamformer 
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design problem. One is to maximize a system utility (e.g., throughput) under some power constraint, 
while the other one is to minimize the system transmission power subject to QoS requirements HI. 
Although both formulations are justifiable and well-studied, the latter is more appropriate for scenarios 
where the users need a guaranteed QoS level. 

Although the QoS-constrained power minimization (QCPM) problem is globally solvable in polynomial 
time for MISO system lIT^ . ifTII . Il2l . this problem is highly non-convex and difficult to solve in MIMO 
systems. In fact, it has been shown that when the BSs and the users are equipped with more than 
two antennas, the problem becomes NP-hard Q- Therefore, many algorithms have been proposed to 
solve this problem approximately. For example, the references 0| and Q propose algorithms based on 
interference nulling, which can completely eliminate the inter-user interference. In these algorithms, the 
search space of transmit and receive beamformers is limited to zero forcing transceivers, leading to simple 
but suboptimal solutions. In addition, such interference nulling based methods require that the number of 
transmit antennas is no less than the total number of active users, which is impractical in many scenarios. 

Another approach for solving the MU-MIMO downlink QCPM problem is based on the iterative 
optimization methods |[6l, @, l|8l, lfT2l . iTTl . References lH, iQ, |[8T| provide iterative algorithms that 
update the transmit beamformers, receive beamformers, and transmit powerj^ by switching between the 
downlink and the dual uplink channels. Central to these methods is the notion of uplink-downlink duality 
(UDD) theory IITTI . 1141 . ifTSl . which guarantees that a set of target SINR levels is achievable in the 
downlink channel if and only if the same set of SINR levels is achievable in the corresponding dual uplink 
channel. We refer to such algorithms as UDD algorithms. The UDD algorithm was first proposed in l[8l 
for the multi-antenna case, where the receive (resp. transmit) beamformer update is followed immediately 
by the transmit (resp. receive) power update. The UDD algorithm of Q differs from that of m in the 
order of updating transmit/receive beamformers and powers. In the UDD algorithm of |[9l, the transmit 
(resp. receive) power is updated exactly after the transmit (resp. receive) beamformer. Importantly, it 
is shown in Q that the UDD algorithm monotonically decreases the total power consumption while 
satisfying the QoS constraints. However, the algorithms in Q can only apply to the single stream 
case. In |l6l the UDD algorithm has been generalized to the multiple stream case under the assumption 
of no joint detection at the receivers (i.e., inter-stream interference is considered). Notice that, to the best 
of our knowledge, it is still not known whether the UDD algorithm converges to a KKT solution. 

Different from the previous works, the references ifTTI and lIT^ have proposed an iterative algorithm 

'in i6i, (91, m, the power allocation and beamforming are separated and thus both need to be optimized. 
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named MMSE-SOCP, which aims to solve the QCPM problem directly. The algorithm consists of the 
following two key steps: 1) Fixing the transmit power, update the receive heamformers using MMSE 
receiver, and 2) Fixing the receive heamformers, update the transmit heamformers hy solving the power 
minimization problem with respect to the transmit heamformers. The authors show that the total transmit 
power monotonically decreases and thus converges. However, the convergence of the MMSE-SOCP 
iterates to a KKT solution is not known. Nevertheless, the authors of I® and lfT2l observe that the 
MMSE-SOCP algorithm always generates a sequence that converges to a unique solution, irrespective 
of the initial point (or at least with high probability, see ®). Hence, a conjecture has been made in 
m, stating that the MMSE-SOCP algorithm probably reaches a local optimum solution of the QCPM 
problerrt 

In this paper, we settle the convergence issue related to the MMSE-SOCP and the UDD algorithm. We 
show that both algorithms converge globally to the set of KKT solutions, regardless of the number of 
streams intended for each user. We start by analyzing the KKT conditions of the QCPM problem of the 
single stream case. Based on the analysis, we propose a novel iterative algorithm called MMSE-DUAE 
algorithm, which is essentially equivalent to the MMSE-SOCP algorithm, but with the added benefits 
of having almost closed form updates and a lower complexity. Through the MMSE-DUAE algorithm, 
we reveal some connections between the UDD algorithm® and the MMSE-SOCP algorithm iflTI . IIT^ . 
More importantly we prove that both the MMSE-DUAE algorithm and the UDD algorithm monotonically 
converge to the set of KKT solutions of the QCPM problem. In addition, we extend the algorithms to 
the multiple stream case and prove that they can also reach a KKT point of the QCPM problem under 
some mild conditions. As will be seen later, the MMSE-DUAE algorithm has a lower complexity than 
the UDD algorithm if the number of streams is greater than the number of transmit antennas. Moreover, 
although both algorithms require feasible initialization, it is easier for the MMSE-DUAE algorithm to 
obtain a feasible initialization (see Remark |2] in Section IV). 

The remainder of this paper is organized as follows. In Section II we give the formulation of the 
QCPM problem and provide a brief review of the existing algorithms. In Section III we propose the 
MMSE-DUAE algorithm which reveals the relation between the MMSE-SOCP and the UDD algorithm. 
Then, we state the convergence results of the three algorithms in Section IV and extend the algorithms 
to the multiple stream case in Section V. Finally, section VI presents some simulation results and Section 


^It is argued in da that, “Though the proposed algorithm always converges and seems to converge to a unique optima 
irrespective of the starting point from the simulation results,it may be possible that the steadystate solution is a local optimum.” 


July 28, 2015 


DRAFT 




4 


VII concludes the paper. 

Notations'. Throughout this paper, we use uppercase hold letters for matrices, lowercase hold letters 
for column vectors, and regular letters for scalars. The superscript ^ is used to denote the Hermitian 
transpose of a matrix. For a complex number a, /(a) and Im(a) denote its phase angle and imaginary 
part, respectively. For a function /(•), Vx/(-) denotes its gradient with respect to the variable x. For a 
matrix A, A ^ 0 indicates that A is a positive semidefinite matrix. I denotes the identity matrix of an 
appropriate size. The circularly symmetric complex Gaussian distribution is represented by CAA(/r, cj^), 
where ji is the mean and is the variance of the distribution. The notations Tr(-) and det(-) represent 
the trace and the determinant operator, respectively. 


II. Problem Formulation And Existing Algorithms 
A. Problem Formulation 

Consider a multi-user MIMO downlink system with K users, where the BS is equipped with M > I 
antennas and each user k is equipped with Nf^ > 1 antennas. Let us use /C = {1, 2, ..., K} to denote 
the set of all users. Assume for now that the BS transmits the single stream Sk to the intended receiver k 
with no multiplexing (the multiple stream case will be considered in Section VI). Let us also assume 
that the BS utilizes the transmit beamformer G (j^Mxi j-q stream Sfc to user k. On the 

other side, user k utilizes the receive beamformer G to estimate its transmitted data stream. 

The estimated data stream can be mathematically expressed as 

4 = rrf +nfcj , '^k G 1C, (1) 

where G denotes the channel matrix from the BS to the receiver /c; G is the 

additive white Gaussian noise (AWGN) with distribution CJ\f{0,a‘^). The data streams sj^’s are i.i.d. and 
independent of the noise level; and have distribution CM{0, 1). 

We are interested in designing the transmit and receive beamformers to minimize the transmit power 
while the users’ QoS requirements are satisfied. Let us consider the signal-to-interference-plus-noise ratio 
(SINR) as the QoS measure. The SINR of user k is given by: 




SINRfc = 


Y.j^kl'^k'^kVjl^ + al\\uk\ 


( 2 ) 
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Mathematically, the QCPM problem can he written as 

K 


(PI) 


mm 

v^u 


S.t. 




fc=i 


uj^UkVkl'^ 


;>lk, V/c G /C, 


Ejyfcl«fHfcr;jf+cj2||rrfc||2- 

where 7 ^. > 0 is the intended SINR level of user A:; the set of all transmit heamformers (resp. receive 
heamformers) is denoted hy r) = {tJi,... ,vk} (resp. u = {ui,... ,uk}). Throughout the paper, we 
assume that problem (PI) is feasible and al > 0 for all k. 


B. Existing Algorithms: A Brief Review 

In this subsection, we briefly review the existing MMSE-SOCP algorithm IT^ and the UDD algorithm 

0 . 

1) MMSE-SOCP Algorithm ifTTI/ . yf72l/ .- The MMSE-SOCP algorithm alternates between the following 
two steps: 

1. Eixing all the transmit heamformers, update the receive heamformers using the MMSE receiver, i.e., 

Ufc = I ^ UkVjvfU^ + all I llkVk, V/c G 1C. 

\jAk j 

2. Eixing all the receive heamformers, update the transmit heamformers by solving 

K 

min 

V ^^ 


k=l 


S.t. 


\u]}Eik'Vk\ 


(3) 


r> 7 fc, VA: G /C, 


T.j^k\'^k^kVj\‘^+al\\ukf- 

which can be transformed to a second-order cone program (SOCP) lfT2l . ifT^ . The above SOCP 
has KM unknowns and can be efficiently solved via interior-point algorithm; each iteration of the 
interior-point algorithm has computational complexity of 0 (jT^M^) ll 22 ]| . 

2) UDD Algorithm Eet Uk and Vk denote the normalized beamformer, i.e., Uk = ^/Ok^ik and 
'Vk = y/Pk^k with Il’Ufcll = Il'Ufcll = 1. We refer Uk and Vk as the normalized heamformers, pk and qk as 
the power consumption. Using these notations, the downlink channel model ([T]) can be rewritten as 

/ ^ \ 

Sk = Hfc ^ ^/PjVjSj +nk \ , yk e JC. (4) 

The UDD algorithm is established by introducing a virtual uplink channel, which can be constructed 
through the following three steps: 1 ) reverse the directions of all links; 2 ) replace the channel matrices by 
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their conjugated transposed version (i.e., •(— 'iky, 3) exchange the role of transmit heamformer 

and receive heamformer. Mathematically, the virtual uplink channel model can he represented as 


K 


Sk = PkVk 


(5) 


qj'U.^UjSj + fifc , Vk G /C, 

/ 

where hk = -^'r^k is the virtual uplink channel AWGN. 

In terms of the channel models dUl and ([5]), the SINRs for the downlink and uplink are respectively 
expressed as 

( 6 ) 


SINR^ = 


^k [T.j^kPj'^kVjvfU.H + all] Uk 


and 


SINR^ = 






V 




(7) 


Then, fixing the heamformers, the downlink power minimization problem can he written as 

K 


min > Pk 

{p.>0}^ 


k=l 


S.t. 


PkWuj^UkVkl 


( 8 ) 


'^k CLj^kPjWjvfHk + 


> ik,yk. 


Its dual problem can be obtained by using the Lagrange duality theory with qk > 0 corresponding to the 
Lagrangian multiplier of the feth QoS constraint ||9l 


K 

max y 

{9'=>o} fit 


s.t. 


<^hk 




(9) 




V 


Ej^k qjUjUjuflik + l)vk 




It can be shown that problem (O is equivalent to the following uplink weighted power minimization 
problem ifTOl 


K 

min > 


s.t. 




qkWvkUkUkl 


( 10 ) 




J2i^k qjUfujufllk + I Wfc 


> Ik^k 


by noting that all the inequality constraints of both problem ® and (ITOl ) must hold with equality at 
the optimality and furthermore the corresponding system of linear equations with respect to {qk} has a 
unique solution lITOl Lemmas 1 & 2]. To summarize, the classical Lagrange duality theory leads to the 
well-known uplink-downlink duality theorem: 
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Theorem 1 (Uplink-Downlink Duality /l9|/, For any given set of normalized beamformers {uk} 

and {Ffc}, a set of given SINR values {'yk}k=i achievable in the downlink using the total power 
consumption P = Pk if ^nd only if the same set of SINR values is achievable in the dual uplink 

channel with the weighted total power of P. 


The UDD algorithm is based on the uplink-downlink duality theory. We summarize the UDD algorithrrt 
m in TABLE ID It should be pointed out that, the UDD algorithm requires a feasible initialization 
Otherwise, the steps 7 and 11 in the algorithm are not well-defined. 

It is also worth noting that the work IIT^ (resp. |!9|) only shows that the MMSE-SOCP (resp. UDD) 
algorithm keeps the QCPM objective function nonincreasing as the iteration proceeds. In this paper, we 
reveal the connection between the MMSE-SOCP and the UDD algorithm. Moreover prove that the two 
algorithms can monotonically converge to a KKT solution of the QCPM problem. 


III. The MMSE-DUAE Algorithm 

In this section, we first analyze the KKT conditions of problem (PI). Based on the results of the KKT 
analysis, we then present a new iterative power minimization algorithm, dubbed MMSE-DUAE, to solve 
the system of KKT equations. Moreover, the proposed algorithm reveals some connections between the 
MMSE-SOCP and the UDD algorithm. 


A. KKT Analysis of the QCPM Problem 


Eirst, let us define the Eagrange function associated with problem (PI) as 

K 

£{X,v,u) = \\vkf 


k=l 


K 


( 11 ) 


1 


+ -hcTfcllufcf- \u^ilkVk\ 


Ik 


k=l 

where A = [Ai A 2 • • • Ax]^ is the Eagrange multiplier vector. Eor a given optimal primal dual tuple 
{u,v,X), the KKT conditions of problem (PI) are given by 


^As compared to the UDD algorithm in Ci Algorithm E] which requires updating uplink/downlink power twice at each 
iteration, the UDD algorithm^ illustrated in TABLE U requires uplink/downlink power update only once at each iteration and 
thus is more efficient. However, the convergence result to he shown later in Proposition 2 also applies to the UDD algorithm in 

Qol. 
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TABLE I 


The UDD algorithm 


. Input: Hfc, (Tfc, 7 fe, A: = 1, 2,..., IT 
• Output: the beamformers and {n^}. 

1 set t = 0 and A" > 1 

2 initialize Vk, k = 1,2,..., K. 

3 repeat 

4 ti —t + 1; 

5 ilk <— + ollj HfcVfc, Mk 

7 update q^’s by solving Go) //uplink power allocation 

8 Uk i — ^/^Uk, Vfe 

9 ^ (l + Hf H,) ■' Hf u,, Vfc 

10 vk^j^,yk 

11 update pk’s by solving //downlink power allocation 

12 Vk <— ^/PkVk, yk 

13 until some convergence criterion is met 


Afc j HfcT’jT’f Hf + all - Hf 1 Ufc = 0, Vk, 


\ii=k 


I - —Hf Wfcuf Hfc + Y AjHf Ujiif Hj j ttfc = 0, V/t, 


Ik 


Ik 




Afc { XI I =0, yk, 

\iyk J 


Ik I YW'^k'^kVjf + al\\uk\\^ j < yk, 

\j¥=k 


Xk > 0 , yk, 


(12a) 

(12b) 

(12c) 

(12d) 

(12e) 


where (I12al) and (I12bl) are the first-order optimality conditions with respect to the receive and transmit 
beamformers, respectively. The equation (I12cl) is the complementary condition; and the equations (I12db 
and (I12el) are the primal and dual feasibility conditions. In the sequel, we analyze the above KKT system. 
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Lemma 1 For any primal-dual tuple {u,v,X) that satisfies ([T2l) . we have Afc > 0,VA: G JC, and all the 
QoS constraints hold with equality. 


Proof: We prove this using contradiction. Assume the contrary that one of the optimal Lagrange 
multipliers, say Xk, equals to zero. Multiplying (I12hl) hy yields 


+ '^>^jVkilfujufiljVk = 0 . 

This implies vj- = 0, which contradicts the assumption that 7 ^ > 0. 

Let us define + o-|l and Aj, = Ylj^k ^kVjvfPi^ + ct|I 




Lemma 2 For any primal-dual tuple (u, v, A) that satisfies (fT^ . the minimum eigenvalue of A^. is zero. 
Furthermore, the optimal normalized receive heamformers are given hy 

Uk = 77 ^ with ilk = Ci^HkVk, yk G JC. (13) 

Proof: Clearly, (I12ab implies that A^ must have at least one zero eigenvalue. On the other hand, 
since 

Afc = C| (^I - y^C-^HkVkV^H^C;^'^ C|, (14) 

Ak has at most one nonpositive eigenvalue. Hence, the minimum eigenvalue of Aj, is zero. Furthermore, 

the equation (fT4l) implies that C^^UkVk = 1 and therefore 

Hfc'Ufc = —HkVkVkUkC'f^^'H.kVk. (15) 

Ik 

Combining ([T5] ) and Lemma [T] it can he verified that Uk = C'^^UkVk is the unique solution of (I12al ) up 
to scaling. ■ 

Defining ^ I + and ^ I + 

fhe next lemma follows directly from the KKT equations (I12hl ) and (I12cl ). The proof of this lemma is 
similar to the proof of lemma | 2 ] and thus omitted from the manuscript. 


Lemma 3 For any primal-dual tuple {u, v, A) that satisfies (112b . the minimum eigenvalue ofBk is zero. 
Moreover, the optimal transmit heamformers are given by 


'^k — f^k~\ 


Vk 


with Vk = ^UkUk, V/c G /C 


IIFfcll ^ 

where the coefficients {pk} A chosen such that (I12cb is satisfied. 


(16) 
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Corollary 1 For any primal-dual tuple {u, v, A) that satisfies ([12]), the Lagrange multipliers {A^} satisfies 
fhe system of equations 


Afc — 


Ik 


1 


Vfe G K. 


(17) 


1 + 7fc 

where T = . Moreover, the unique solution of (ITt]) can he obtained hy a 

fixed poinf iteration. 


Proof: From LemmaH] we have = D^ —^ 0. It follows from Schur complement 


that 






1 


^ 0 . 


(18) 


> -^k "fc 

Since D/j is positive definite, using Schur complement again implies 

HfeD-^Hf rrfc < 1. 

Ik 

For any primal-dual tuple (ri, v, A) that satisfies the KKT condition ([12]), the above inequality must hold 
with equality; otherwise 7 0 by the Schur complement, which contradicts Lemma |3] Hence, it holds 
that 


Afc — 


Ik 


(T-i - AfcHf Ufcrrf Hfc) ^ Hf rxfc 


Mk G K. 


(19) 


On the other hand. 


( 20 ) 


rrf Hfc (Y-i - AfcHf Hf 

=rrf Hfc (I - AfcTHl^tXfcrxf Hfc)"^ TH|^tXfc 
=rrfHfcTHfrxfc (l - Afcrr|^HfcTHf rrfc)"^ , 

where the second equality is due to the identity (I + AB)-iA = A(I + BA)-i||2l] Sec. 3.2.4]. Hence 
([T9] ) can be rewritten as 


Afc 7fc 


1 


- Afc , VA: G /C, 


( 21 ) 


u"HfcTH"«fc 

which implies ([TT] ). Moreover, the right hand side of ([TT] ) is a standard functiorQ of {Afc}. Hence, the 
solution of ([TT]) is unique and can be obtained by a fixed poinf algorithm fTTI . ■ 


''a vector function /(A) is a standard function if it satisfies 1) /(A) > 0; 2) /(A) > /(A') for A > A'; 3) af{\) > f{a\) 
for a > 1. If /(A) is a standard function, the system of equations A = /(A) has a unique solution which can be obtained by 
a fixed point algorithm. See more details in OH. 
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B. The Proposed MMSE-DUAL Algorithm And Its Relations With The Existing Algorithms 

Based on the results of the KKT analysis, we here present a new iterative power minimization algorithm, 
duhhed MMSE-DUAL algorithm, to solve the system of KKT equations (ll2aH12el) . Our proposed MMSE- 
DUAL algorithm first updates the receive heamformers using the MMSE receiver (fT3] ). followed hy the 
update of the transmit heamformers using equations (fT^ and ([TT]) . The algorithm is outlined in TABLE HI] 
In this table, N denotes the total number of fixed poinf iferafions for calculafing fhe opfimal Lagrange 
multipliers. 

Before stating the properties of the proposed algorithm, let us first see how the MMSE-DUAL algorithm 
plays a key role in establishing the connection between the MMSE-SOCP algorithm and the UDD 
algorithm. Lirst notice that in the MMSE-DUAL algorithm, the procedure of updating the transmit 
heamformers (i.e.. Steps 7-13 in TABLE II) is equivalent to solving 


K 



(P2) 




>'yk, yk € 1C. 


s.t. 




This follows from the fact that the KKT condition of (P2) are identical to (I12blll2ei) and strong duality 
holds for problem (P2)||T6l. Since the updates of the receive beamformer in MMSE-DUAL is the same 
as the receiver update in the MMSE-SOCP algorithm, the MMSE-DUAL algorithm is in essence the 
MMSE-SOCP algorithm. The only difference of the MMSE-DUAL algorithm with the MMSE-SOCP 
ina is that, instead of updating the transmit heamformers by directly solving the SOCP (P2), we use 
semi-closed form computation (O and (fTTI) . It is not hard to see thao the complexity of each iteration 
of the fixed point algorithm is dominated by the computation of T“^, which is 0{KM‘^ + M^). Hence, 
the MMSE-DUAL algorithm has lower complexity than the MMSE-SOCP algorithm. 

Next we explore the relation between the MMSE-DUAL and the UDD algorithm. Comparing the 
algorithms in TABLE I and II, it is not difficult to see that, the dual variables {A^} and the auxiliary 
variables {pk} in the MMSE-DUAL algorithm respectively play the role of the dual uplink transmit power 
and the downlink transmit power in the UDD algorithm. This implies that, although the UDD algorithm 
is developed from a different point of view, it works in a similar way as the MMSE-DUAL algorithm 
towards solving the KKT system (fT^ . Eurthermore, the constraints of problem ([8]) must be satisfied wifh 

^In this paper, we consider practical cases for complexity comparison, i.e., when the number of transmit antennas is greater 
than the number of antennas at each receiver. 
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equality at the optimality. Hence it is readily seen that the MMSE-DUAL algorithm updates the auxiliary 
variables {nk} in the same way as the downlink transmission power {pk} in the UDD algorithm; see 
Step 11 in TABLE I and Step 13 in TABLE II. The only difference between the two algorithms lies in 
the update of the dual variables {A^} (or equivalently the dual uplink transmit power qk in UDD). In 
the MMSE-DUAL algorithm, the Lagrange multipliers {A^} are updated by the fixed point algorithm 
independent of the current transmit beamformers, while the update of uplink transmit power in the UDD 
algorithm depends on the current transmission beamformers; see Steps 7-10 in TABLE II and Step 7 in 
TABLE I. Note that, if problem (fTOl ) is feasible, the update of the uplink transmit power in the UDD 
algorithm is equivalent to solving a linear system of {qk} which has complexity of 0{K‘^M+K‘^). Hence, 
when M K, K, the UDD algorithm and the MMSE-DUAL algorithm have comparable complexity. But 
in the general single stream case where M > K, the UDD algorithm has lower complexity than the 
MMSE-DUAL algorithm. 


TABLE II 

The MMSE-DUAL ALGORITHM 


1 

2 

3 

4 

5 

6 

7 

8 
9 

10 

11 

12 

13 

14 

15 


Input: Hfc, al, 'Tk, k = 1,2,..., K 
Output: the beamformers {ufc} and {u^}. 
set t = 0 and N > I 


tialize Vk and Xk, k = 1,2,..., K. 


- t 4- 1; 


HfeV.vf Hf -b ail) ' HfcVfc, VA: 

ir n = 1 to N //fixed point algorithm 

1 


Y 

Xk V 

nd for 


_ 

l+7fc uf HtTH 






VA: 


-kUk, VA: 


Ive for the linear system of 

^iJ-k\Uk'iikVk\'^ - Yj^k tJ-j\Wk^kVjf = o-l\\ukf, VA: 
^ U fkk'^k, VA: 

some convergence criterion is met 
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In a nutshell, similar to the MMSE-DUAL algorithm, the MMSE-SOCP algorithm and the UDD 
algorithm both work towards solving the KKT system (fT^ . In the next section, we rigorously show that 
the three algorithms indeed monotonically converge to a KKT solution. 


IV. Convergence Results of the MMSE-DUAE/MMSE-SOCP/UDD Algorithms 

In this section, we establish the convergence of the three algorithms. Compared to the existing con¬ 
vergence results of the MMSE-SOCP algorithm in lIT^ and the UDD algorithm in Q, we show below 
a stronger convergence result that every limit point of the three algorithms is a KKT solution of (IT^ . 
Before stating the convergence results, we first present three lemmas which will be used later in the 
convergence proof. 


Lemma 4 For any feasible {wfc}, the optimal solution to problem ([3]) is unique up to phase rotation. 


Proof: Eet and {vf*} be any two optimal solutions to problem ([31). Moreover, we define 
= Z. and = Z V/c G 1C. In the following, we prove 

VA: G 1C. 


It is noted that any feasible solution to the following SOCP 

K 


mm 

V 




Fk\ 


k=l 


s.t. e 


-isi 




u^UkVkZ \uj!llkVj\‘^+al\\uk\\‘^, V/c G 1C, 


( 22 ) 




= 0, V/c G /C 

is feasible to problem ([3]). It follows that the optimal value of problem ([3]) is not greater than that of 
problem (l22l) . On the other hand, it is easily seen that the optimal solution {v'^} to problem (l3]l is a 
feasible solution to problem (l2^ . Hence, {v^,} is an optimal solution to problem (l2^ . Similarly, we infer 
that is an optimal solution to the following SOCP 


K 


min > llrifcl 

V ' ^ 

k=\ 

s.t. — 






ilkVk> \ujfilkVj\‘^+al\\uk\\‘^, V/c G 1C, 

V iVfc 


(23) 


Im(e u^FikVk) = 0, V/c G 1C. 

By comparing the above two SOCP formulations and noting IP’ ^e conclude 

that is an optimal solution to problem (l22b . Since the SOCP problem (1221) has a strictly 
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convex objective function, it has a unique solution. Thus we have V/c E /C, implying 

that the optimal solution to problem ([3]) is unique up to phase rotation. This completes the proof. ■ 

Lemma 5 If {u^} and {vf^} satisfy the SINK constraints of problem (PI) with equality and for each k 
Uk is an MMSE-receiver, i.e., = akC^^UkVk for all k with at being an arbitrary nonzero constant, 

then we have 


1 


Cfc - —HkVkV^U^ ^uk = 0, V/c. 
7fc 


(24) 


Proof: Since {u^} and {v}f\ satisfy the constraints of problem (PI) with equality, we have 

^ \\u^EikVjf+al\\ukf - — |rifHfcr)fc|^=0, V/c 


which can be rearranged as 


[Ck- —ElkVkVkP^k ]uk = 0, V/c. 


1 


7fc 


HttH 


Ik 


(25) 


By substituting the MMSE receiver Uk = akC, into (l25l) and noting that ak / 0, V/c, we get 


v^Uj^Cf^UkVk - ^^v^U^C^^UkVk j = 0, Vfe. 
Since we have vjfH^CT^UkVk / 0 (due to HkVk / 0), it follows that 


1 


1 

7fc 


v^iij^C)^^iikVk = 1 , yk. 


(26) 


This implies that for each k the matrix Ck — ^HkVkvj^H^ is positive semidefinite. Hence, from 
we obtain 


1 


Ck - —UkVkvj^U^ ] Uk = 0, V/c, 
7fc 


(27) 


which completes the proof. ■ 

Due to the uplink-downlink duality, we also have the following lemma. The proof of the lemma is 
similar to that of Lemma |5] and thus omitted for brevity. 

Lemma 6 If {uk} and {vk} satisfy the SINK constraints of the virtual uplink weighted power minimiza¬ 
tion problen^ (1101 ) with equality and moreover for each k, Vk is a (virtual uplink) MMSE-receiver, i.e., 
Vk = Uk with Pk being an arbitrary nonzero constant, then we have 


Dfc- UkUkUktlk ) I’fc = 0, V/c, 

7fc 


(28) 


®Note that the SINK constraints in ( flot hold true for 


Vk s. 
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where ’5 are defined as in Section 111. 

Remark 1 Lemmas |5] and |6| indicate that, for the downlink/virtual uplink power minimization problem, 
if a set of transmit and receive beamformers satisfies the SINR constraints with equality and moreover 
complies with the MMSE receiver structure, the first-order optimality condition with respect to the 
downlink/virtual uplink receive beamformers follows. In other words, if a set of transmit and receive 
beamformers fulfills both the assumptions of Lemma |5] and Lemma |6] then it is a KKT solution to the 
KKT system (I121) . 

A. Convergence of the MMSE-SOCP/MMSE-DUAL Algorithms 

In this subsection, we study the convergence behavior of the MMSE-SOCP (or equivalently MMSE- 
DUAL) algorithm. 

Proposition 1 Let rr'’, denote a sequence generated by the MMSE-DUAL algorithm (or 

equivalently the MMSE-SOCP algorithm). Suppose is feasible for problem (PI), then every 

limit point of {{v'^ is a KKT point of (PI). 

Proof: Here we prove the result for the MMSE-SOCP algorithm. The proof for the MMSE-DUAE 
algorithm follows immediately due to its equivalence to MMSE-SOCP algorithm. The iterations of the 
MMSE-SOCP algorithm are illustrated as v'^~^ ^ v^, where the two arrows correspond to the 

two update rules shown in Sec. II.B in order. Since the objective function is coercive, {v'f] is bounded 
and consequently is bounded as well. Hence, the sequence has at least one limit point. 

Consider a subsequence converging to the limit point {u*,v*}. Moreover, by further 

restricting to another subsequence, we can assume that converges to a limit point v**. 

In the sequel, we first prove that v* = v** (up to a phase rotation). Clearly, 

K K 

= ( 29 ) 

k=l k=l 

since the objective value is decreasing and it is bounded from below. Now consider a fixed transmif 
beamformer v so that 

SINRfc(r;,rr*fc) >7fc,VfcE/C, (30) 

where SINRk{v,uf) is defined in (|2]). Due to the continuity of the SINR function, there exists an index 
i so that for all j > i, SINRfc(r), ) > 7fc,VA: G /C. Since at each iteration of the algorithm, the 
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transmit beamformers are updated after the receive beamformers, for all j > i we have IP ^ 

'^k=i ll'*^fclP- Letting j —)• oo implies 

K K 

EiKif ^ Eii»tif- pi) 

k=l k=l 

Furthermore, according to the update rule, we have SINRfc(r)^^, > 7 fc,VA: and thus 


SINRfe(t;*,rr*,) >7fe, Vfc E/C. 


Combining 


with the fact that (OTI) holds for any v satisfying (1^ . we obtai 

K 

V* E argmin ||'*^fc|P 
fc = l 


iilzl 


(32) 


(33) 


s.t. SINRfc(r’,rifc) > 7 fc,V/i;. 

On the other hand, since the update of receive beaformers using MMSE receivers keeps the SINR 
feasibility, we have SINRfc(t 7 ''^“^,rr^^) > 7 ^. Letting y —)• 00 , we obtain 


SINRfc(r;”,ii*,) > 7 fc, VA:. 


(34) 


Combining (l3^ . d^l) and (|2^ . we infer that v** is also an optimal solution to problem (l3^ . Hence, 
according to Lemma IH we have v* = v** up to an appropriate phase rotation. 

Next, with v* = v**, we prove that the limit point {u*,v*) is a KKT point of (PI). Based on 
the receive beamformer update rule in the algorithm, where := 

+ fj^I. Letting j ^ 00 implies 

ul = {Cl)-^nuviyk (35) 


with + fj^I. On the other hand, ([33]) implies that there exists a set of 

multipliers > 0 so that 


<=0, VA:, 


Ik 


(36) 




Ik [Y,\\i<f^kV*f+al\\ulf I -|(rx^)^Hfc<p=0, Vfc. 
\j¥=k 


(37) 


’Note that, for any v such that SINRfe(t;,nJ) > 7 fc,VA: G K., we can scale up v with any constant s > 1 so that the 
scaled v (i.e., sv) satisfies Oil- Furthermore, analogous to (in), we have J2k=i ^ '7s > 1, implying 

nllLi ll^fclP- Therefore, combining ( 132b with the fact that ( 131b holds for any v satisfying ( 130b implies ( 133b . 

Similar arguments are also used in the proof of Proposition 2. 
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Fig. 1. The flow chart of the UDD algorithm. 


By Lemma [51 we infer from (l35l) and (l37l) that 


1 


Cl - -Ilkvlivlfill! ) = 0 , Vk. 

Ik 


(38) 


Clearly, the equations (l36l) . (l37l) and (jSS]) imply that the limit point {u*,v*) is a KKT point of (PI). 


B. Convergence of the UDD Algorithm 

The following theorem states our convergence result of the UDD algorithm: 

Proposition 2 Let {{v"^,vJ' denote a sequence generated hy the UDD algorithm. Suppose 
{v^,q^) is feasible for problem (PI), then every limit point of {(■?;'',p*”, ■u’', is a KKT 

point of (PI). 

Proof: For the ease of understanding, the iterations of the UDD algorithm are visually presented in 
Fig. [T] where each arrow indicates an update rule as labeled. Let 

be the sequence generated by the UDD algorithm. Clearly, the sequences and {it^} are bounded. 
On the other hand, since the objective functions of problems (| 8 ]l and (ITOl ) are both coercive, {p^} and 
{g'"} are also bounded. Hence, the sequence {v^,p^,u^,q'^} is bounded. It follows that there exists 
a subsequence {v^fp^fu'^fq'^^} converging to a limit point {v*,p*,u*,q*}. Furthermore, by further 
restricting to a subsequence, we can assume that the subsequence converges 

to some limit point {v**,p**,u**,q**}. According to @, we have the monotonic convergence, i.e., 

0 < EtiP'C < < eUpi < implying ^at ETiPr = = 

Yl,k=iP*k — Yl,k=i^k^k- 

First, we prove that p* is the optimal solution of problem (| 8 ]) with ujfs and tj^’s being fixed to ri|,’s and 
■u^’s respectively, and consequently SINR^(p*,ij*, ti^) = 7 ^, V/c G 1C. Let Sp = {p \ SINR°(p, v*,ul) > 
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7 fc, G /C}. Due to the continuity of the SINR functions, we can always find an integer J, such that for 
all j > J, 

SlNR^{p,v''\ul^) > 7fc,V/c elC,'^p e Sp. 

Step 11 of the UDD algorithm [see (a) in Fig. [H implies 

> 7 fc,Vfe G/C 

and 

K K 

^p''^ < '^Pk^^P^Sp. 
k=l k=l 

Taking limit as j ^ oo yields 

> 7 fc,VA:G/C (39) 

K K 

'^Pk< '^Pk,'^P G Sp. (40) 

k=l k=l 

([ 8 ]) the SINR constraint must hold with equality, (l39l) and (l40l) implies 

SINRD(p*,r,tr^) = 7 fc,VfcG/C. (41) 

Similarly, we next show that q** is the optimal solution of problem (ITOl) with •u^’s and Ffc’s being 
fixed fo and v'^’s respectively, and moreover SINRy(q**,-u**,ti^) = 7 ^., \/k G JC. Let Sg = 

{q I SlNR)^{q,u**,vl) > 7 fc, Vfc G /C}. Due to the continuity of the SINR functions, we can always find 
J, for all j 7 J, such that 

SINR]!{q,u^^+\vl^) > G /C,Vg G 5,. 

Due to Step 7 of the UDD algorithm [see (c) in Fig. [Tl, we have 

SlNR]^{q^^+\u^^+\vl^) > 7fc,VA: G /C. 


and 


Since at the optimality of problem 


and 


Hence, we infer that 


and 


K K 

,2 rj+l 


(yhk ^ Y ^ ^1- 


k=l 


k=l 


K 


K 


Y^kQk* < Y^kQ^Q G Sg 


k=l 


k=l 


SlNR^^{q**,u**,vl)=^k,yke}C. 


(42) 


(43) 
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Now we show u* = u** after doing an appropriate phase rotation. Due to the feasible initialization, 
we have for any Vj that [see (h) in Fig. [H 

Taking limit as j —)• oo yields 

SINR^ip*,v*,ur) >jk = SmR^{p*,v*,ul),yk G 1C (44) 

where the equality is due to (|4TI) . In the following, we show that the inequality in (l44b actually achieves 
equality. Define % = SINR^ {p *, v *, u '^*) and assume for contrary that there exists one 7 ^ that is strictly 
greater than 7 ^. By the uplink-downlink duality theory, there exists {qk} such that SINR^(q, w**, = 

7fc for all k and '^k=i^k^k = 'Y^k=iP*k- Since there exists one k for which 7^ > 7^, the total 
power be further decreased hy reducing q^. Hence, (l42b and (|4^ imply ^k^T < 

'l2k=i^k^k = Y.k=iPk- This yields a contradiction due to the fact that Y^kPk = Hence, we 

have 

SmR^{p*,v*,ul*) = SmR^ip*, v*,ul), yk G /C. (45) 

Note that Steps 5-6 of the UDD algorithm [see (h) in Fig. [H imply 

E I ilkV*k,yk G 1C, 

\jyk ) 

where is normalization factor. From the above equation, we infer that •u” maximizes SINR^ {p*,v* ,Uk) 
with respect to Uk- It follows from (l45l) that also maximizes SINR^ip* ,v* ,Uk). Thus we have 
iHu’l* = 'dfc, Vfc G 1C for some complex valued scalar iH with |r9| = 1. 

Next, we show q* = q** and further SINR^(g*, ft*, = 7 ^, Vfe G 1C. Step 9 of the UDD algorithm 
[see (d) in Fig. [H implies 

SINRU(g’'7tZ'-7F;;0 > 7 fc,Vfc G/C. 

Taking limit as j — 00 , we have 

SINRU(g*,F*,F^) > 7 fc,VfcG/C. 

and thus 

SINRU(g*,F**,F^) > 7 fc,VfeG/C. (46) 

by noting Ou*^ = u%. Combining (@61), (02]), and Yjk=i^kik = Y.k=i^k^k*’ ^bat both ql’s 

and qk*’s are the optimal solutions to problem ([TOl) with there Uk’s and F^’s replaced by F”’s and F^’s 
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respectively. Since problem (fTOl) has a unique solution lITOl . we conclude = g”, Vfc G 1C, and 


SINRy(g*,riM3^) = 7fc,VfcG/C. 


(47) 


Now we are ready to end up the proof. By noting 'du*fC = u\ and q** = q*, Step 5-8 of the UDD 
algorithm implies 


-1 


= ad ^ + all Vfc G JC. 

\j^k J 

where at is a normalization factor. On the other hand, Step 9-12 of the UDD algorithm implies 


(48) 


Vi. = 


PI I I + G JC. 

j¥=k 


where /3^ is a normalization factor. 

Eqs. (|4T1) . (1471 ). (|48] ). and (l49l ) can be equivalently written as 


Ik 


— 11^ 

jii — (^kW^kW 


3¥^k 


- Y = WvV'^ 


Ik 


3 3 I 


3¥=k 


ul = aliCir^Ukvl 


,*{v*)^IllP + al^ 
Combining Lemma [51 (l50l) . and (l52l) . we obtain 


where = E,^k D*, = I + Ej^k Hf rx*(rx*)"H,. 


1 


Cl--ilkvlivlEU^]ul = 0 

Ik 


Similarly, Lemma 0 (ISTI) . and (1531) imply 


1 


r;^ = 0 

Ik 


(49) 


(50) 

(51) 

(52) 

(53) 


(54) 


(55) 


It can be readily seen that, (l54l) . (l55l) . and (l50l) implies the KKT condition (IT2l) with = 1 for all k. 
Thus the proof is completed. ■ 


Remark 2 Although both algorithms require feasible initialization, it is easier for the MMSE-DUAL 
algorithm than the UDD algorithm to obtain a feasible initialization. For example, when M > K, it 
is guaranteed that problem (PI) with any given nonzero u^’s is feasible (e.g., zero-forcing solution for 
Vk’s) and thus the MMSE-DUAL algorithm can be randomly initialized in this case. However, random 
initialization for the UDD algorithm in this case may fail. This is also verified with a specific example 
in Section VI. 
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V. Extension to Multiple Stream Case 


Now we consider the extension of the two algorithms to the multiple stream case. Differently from 
0, we assume that joint detection is employed at receivers. Let he the transmit heamformer for user 
k. In this case, each user’s achieved rate is given hy 

Rk = logdet (I + HfcVfcVf Hf 1) 

where ilk — interference plus noise covariance matrix. We are interested 

in solving the following rate constrained power minimization problem 

K 

triin^Tr(VfcVf) 

^ k=i (56) 

s.t. Rk > ^k, k G 1C 

where rk represents the rate requirement for user k. 

It is known that the streams of user k can he decoded sequentially without loss of information using 
MMSE receiver coupled with sequential interference cancelation (SIC) technique ifTSl . |[20ll . Indeed, it is 
easily verified that 


dk 


Rk = Yl + SINRfc,™) 


(57) 


m=l 


where 


SINRfc,^ ^ 




(»il + E?i, + ES„+i ut,, 

Vk^m is the m-th colurrm of V^, i.e., the transmit heamformer for stream m, and 

/ d,i dk \ ^ 

'^k,m — I ^k^ ^ ^ ^ ^ ^ ^ ^ j HkVk,m 

V j¥=k i=l 


i=m+l 


is referred to as MMSE-SIC receiver. 


Define 'yk,m = 6'^'= — 1, m = 1, 2,... , With equal rate allocation ^ across multiple streams, Liu. 
et. al |[20l Theorem 4] proved that the following SINR-constrained power minimization problem 

K dk 

min^ ^ \\vk,m\\‘^ 


k=l m=l 


S.t. 


ul^ilkVk, 


U 


H 

k,m 


(Jt 


H-hH 
k 


, UU ™+i 

m = 1,2,..., dk, k G K,. 


> Ik,-. 


(58) 


Uk . 
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can achieve the same optimal solution as that of problem (l56l) . However, we still cannot solve problem 
(15^ to global optimality. Fortunately, the special structure of Problem (l5^ allows us to apply the UDD 
algorithm or MMSE-DUAL algorithm. Since the UDD algorithm or MMSE-DUAL algorithm reaches a 
KKT point of problem (l5^ . a question arises: whether a KKT point of problem (l5^ is also a KKT point 
of problem (|5^ . In the following proposition, we show the KKT equivalence of the two problems under 
a mild set of conditions. The proof is relegated to appendix. 


Proposition 3 Let {vk,m-,Uk^m} be a KKT point of problem (1581) . and let 

dk 

'^k,m = fifc + ^ . 

i=m 

Suppose {Vk,m] satisfies / 0 , m = 2,3,... ,dk, k e K, then 

1) {vk,m} A a KKT point of problem (l56l) . 

2) A KKT point of (1561 ) can be obtained by solving Problem (1581) using either the MMSE-DUAL or 
the UDD algorithm. 

Remark 3 It can be shown that the condition 7^ 0 , m = 2,3,... ,dk, k ^ 1C is 

equivalent to ^Tlk'^kp 0, m = 2,3,... ,dk, k ^ K; see (|6^ in Appendix. This means that, for each 
user k, detection of all the second, third, ..., and the dk-th symbols are interfered by the first symbol, 
which is generally true in the multi-stream scenario. 


Remark 4 In the proof of Proposition\^ the assumption ^^^^HkVk^m 7 ^ 0, m = 2,3,... ,dk, 

k G K is used to obtain i = Xk^2 = ■ ■ ■ = Xk^d^’ k G K, which finally leads to Part I). It is worthy 
mentioning that, if this assumption is relaxed, there indeed exists some example (shown in the end of this 
paper) where i = Xkp = ... = Xk^dk’ k G JC may not hold and in this case the KKT point {vk^m} of 
problem (158b is not a KKT point of problem (156b . 


Remark 5 Let K = Similar to the single stream case, it can be shown that, for the multi-stream 

case, the complexity of each fixed point iteration in the MMSE-DUAL algorithm 0{KM‘^-\-M^), while 
solving the system of equations for the K dual variables in the UDD algorithm requires the complexity 
of OiMK"^ + K^). Hence, in the general multi-stream case where > AI, the MMSE-DUAL 

algorithm has a lower complexity than the UDD algorithm. 


®Note that in the multi-stream case the matrix inversion operations in the fixed point iteration can still be recursively computed. 
This is why we have the term 0{M^) as in the single stream case. 


July 28, 2015 


DRAFT 




23 


VI. Simulation results 

In this section, we numerically evaluate the performance of the MMSE-DUAL algorithm and the UDD 
algorithm. Note that, we here only provide the convergence performance of the two algorithms in the 
single stream case hut similar convergence behavior is also observed in the multiple stream case. The 
QoS level and noise variance are set equally to be 7 and cj^ across all the users. Uncorrelated fading 
channel model for all channel matrices between users and the BS are assumed. Each channel coefficient 
is generated from the zero mean complex Gaussian distribution with unit variance. We also set A" = 20 
for the number of fixed point iterations. 

A. Infeasible initialization 

In our first numerical experiment, we study the effect of the infeasible initialization on the algorithms. 
In the experiment, the BS serves two users, all equipped with two antennas, i.e., M = N = K = 2. We 
set 7 = 10, = 1, and the channel matrices between the BS and the two users are respectively 

0.2097 + 0.0429f 0.4385 + 0.1650f 

Hi = , (59) 

-0.9788 + 0.1614i 0.1543 + 0.5013f 

-1.0800 - 0.3203f 0.2582 + 0.1785f 

H2 = . ( 60 ) 

0.1714 - 0.2729f -0.9692 - 0.1711f 

With initial transmit beamformers 

= [0.0701+0.7443i - 0.3386+0.0235i]'^, 

V2 = [-1.3709+2.0320i 0.1491-0.0298f]^, 
the corresponding normalized MMSE receivers are calculated as 

ui = [-0.7423-0.1885i - 0.2951-0.5713i]'^, 

U2 = [0.7580-0.6429f - 0.1084+0.0209f]^, 

leading to SINR values, SINRi = 0.1592 and SINR 2 = 4.3871, which are both smaller than the required 
SINR value 7 = 10. Eurthermore, it can be easily checked that the linear system on qi and q 2 with the 
fixed initial beamformers 

—qfclffHfrZfcp -'^qjWvjfufujf = \\vkf,k = 1,2 
Tfc “it 
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Number of iterations 


Fig. 2. Infeasible initialization of MMSE-DUAL algorithm 



Fig. 3. Similar behavior of MMSE-DUAL and UDD algorithm: if = 4, M = 7, = 3, 7 = 10, = 1. 

has negative solutions qi = —3.5627 and q 2 = —1.1379. Therefore, the uplink power update cannot 
he done in the UDD algorithm. While the UDD algorithm fails with this initialization, the MMSE- 
DUAL algorithm can quickly reach a feasible point in the second iteration and then exhibits a monotonic 
convergence in subsequent iterations, as shown in Fig. |2] 

B. Convergence property 

In this set of numerical experiments, we randomly initialize the MMSE-DUAL algorithm. The UDD 
algorithm is initialized by a feasible point obtained by few iterations of the MMSE-DUAL algorithm. 
Figure [ 3 ] shows that the MMSE-DUAL algorithm and the UDD algorithm have a very similar convergence 
behavior. 

Figures |4] and |5] show that the two algorithms can almost always converge to a same objective function 
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Fig. 4. The MMSE-DUAL algorithm often converge to a same objective value: fT = 3, M = 4, A = 3, 7 = 10, = 1. 



Fig. 5. The UDD algorithm often converge to a same objective value: iT = 3, M = 4, = 3, 7 = 10, cr^ = 1. 

value which may he global optimum regardless of initial points (different initial points are denoted hy 
circles). However, in an extremely rare case, local convergence for the MMSE-DUAL algorithm (also for 
the UDD algorithm) was observed in Fig. where two different initial points resulted in two different 
objective values upon convergence. 


VII. Conclusion 

In this paper, we have considered the SINR-constrained power minimization problem for MU-MIMO 
system. Based on the KKT analysis of the power minimization problem, we propose the MMSE-DUAL 
algorithm. Although the latter algorithm is in essence the MMSE-SOCP algorithm in lIT^ . it connects 
the MMSE-SOCP algorithm and the UDD algorithm. It is shown that the UDD algorithm^ also works 
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Number of iterations 


Fig. 6. The MMSE-DUAL algorithm (also the UDD algorithm) may converge to different local solutions depending on the 
initialization: K — M = IQ, N = 2, ^ = 100, = 0.1. 


towards the KKT condition of the QCPM problem as the MMSE-DUAL/the MMSE-SOCP algorithm. 
Eurthermore, we theoretically prove that all three algorithms can monotonically converge to a KKT 
point of the QCPM problem. Our numerical experiments show that the three algorithms almost always 
converge to a same value which may be the optimal value, but local convergence of these algorithms is 
also observed. 


VIII. Appendix 


A. The Proof Of Proposition 3 

Proof: The proof of the second part of Proposition 3 is trivial once the first part is proven. Hence, 
we here focus on proving the first part of Proposition 3. Eet \k,m, be the Eagrange multiplier associated 
with the constraint of problem (l5^ indexed by {k,m). The KKT condition of Problem (l5^ is given by 
1 






1 '^k,m 0 ? 


lk,i 


(61a) 


m—1 


I + XI XI + X - ^^ilkUk,mUk,miik | T’fc.m = 0, 


j¥=k *=1 


2=1 


7fc,r 


^k,m — 0,V?71,/c. 


'lk,,mi 


(61b) 
(61c) 
(6 Id) 
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In the following, we are going to show that given any tuple {vk^m,Uk^m, ^k,m} satisfying the above 
system, {vk^m, ^k,m} must also satisfy the KKT condition for problem (l56l) . The proof is divided into 
two steps. 

In the first step, we prove that (I61bl) can be equivalently rewritten as the first-order optimality condition 
of problem (15^ by using (I61bl ) and (I61cl ). and showing = Xk ^2 = ■ ■ ■ = Xk^d^’ From (161 at . we 
infer that Uk m must be in the form of MMSE receiver 


Uk ,m — ^kin+l'^kVk, 

where f3k,m is an arbitrary nonzero scalar. By taking I3k,m = 


Vl+7fe,, 


and using (1621) . we have 


.H 


1 


H/j Uk^m'tJ'k,m^k ~ ^k,m+\^k'^k,'mVk,m^k ^k,m+\^k- 


+ lk', 


Moreover, from (161 cl) and (l62l) . we have 


(62) 


(63) 


7fc,m = ^ 


/c,m+l 




(64) 


It follows that 


Hf 

'^k,m'^k^m^> 


1 

1 + 

=Hf 

( '1'“^ — 

=Hf 

( — 


^k,m^k k,m+l^k 




- {^k,m+l + nkVk,mVk^rn^k) ^ ) H 




-1 

k^m 


Hi 


where in the second equality we have used Woodbury identity 11211 . Similarly, we have 

H^. Uk^m'^k,m^k'^k,m 

‘■k k,m+l^kVk,m 
'^k^m 




1 + Xk,i 

Xk^m I 1 


n.k Mr 7, 


~lk,r 


Tfc.i 


1 - 


l + 7fc,my 


HkVk . 




1 T 'yk,r. 




^A: ^k,m+l^kVk,m 


■k ^ k,m+l^kVk,m 
^k k,m+l^k'^’k,m'^’k^rn^k k,m+l^k't^k,-. 


—7fc,mHi, I ^k,m+l 
■ k,m^ 




1 + Ik,', 


^kin+ltikVk,mV^,m^^^k!m+l ' 

i + '^k,'m^k k^+l^kVk,m ^ 


^^k^k,r, 


—7fc,mHi. ^HkVk^', 


(65) 


( 66 ) 
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where we have used the relation '')k,m = '^k rri^k third equality, and the 

Woodhury identity in the last equality. 

By using (|6^ . we have 


LL j (Xj 


j^k i=l 

Using (1651) . we get 


3¥^k 






m—1 


m—1 


Hi = 2 Ai,.Hf - HAij H 


2=1 


2=1 


and using (1^ . we obtain 


= \,m}^k'^klr3^kVk,r. 


Ik,7 


By defining 


1 


i- + lk,i 


and substituting (l67]) . (IMI) . and (l69l ) into (I61bl) . we have 

dj m—1 

I + + X!/ (^^k,i+l ~ ^k,i ) j Vk,m = 0 

i=l 


2=1 


By noting that 


m—1 


2=1 


E ('I'd+l - 

1 

m—1 

+ X (Aa:,* - Xk,7+i)ll^^-}^^Uk, 


2=1 

we rewrite (I70l) as 

dj m—1 

I ~ AfcqH^ + X! ~X X! ~ Afc^j+i)H^ j Vk,m = 0. 

j^k 2=1 2=1 

Considering (17^ with m = 1 and m = 2, we have 

dj 

I - Afc,iHf + X E I = 0 

j//c 2 = 1 
dj 

I - + X I] + (Afc,l - Afc,2)H^^fc,2Hfc | ^A:.2 = 0. 

jr^k 1=1 

Left-multiplying on both sides of (1741) and using (1731) yeild 


(67) 

( 68 ) 

(69) 

(70) 

(71) 

(72) 

(73) 

(74) 


(Afc,l - Xk,2)Vk,lH.k'^k^2^kVk,2 = 0 
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implying = \k ^2 due to y.]^kVk ,2 / 0 by assumption. Recursively, we infer from (1721) 

that Afc,i = Afc,i+i, by using the condition •Hfcr'fc,* / 0, i = 2,3,..., dfc. Hence, by letting 

for all k, and using = [v^^i Vk ^2 ■ ■ ■ oan compactly write (1721) as 

(I - A, ^ j Vfc = 0. (75) 

\ j^k i=l ) 

Note that we have 

Vv, logdet(I + HfcVfcVf 
=Vvfc (log det ^k,i - log det Ctk) 

=Vvfc logdet’J'fc,! = 

and 

Vv. logdet(I + H, V,Vf Hf fi-i) 

dj dj (77) 

= Vv. log det(I + H.r;,,T,,V^. 

i=l i=l 

Substituting (17^ and (1771 ) into (1751 ) yields 

Vfc - AfcVv, logdet(I + HfcVfcVf Hf fi-i) - A,Vv. logdet(I + H,V,Vf Hf fi-^) = 0 (78) 

j¥^k 

which is the first-order optimality condition of problem (156l) . 

In the second step, we prove by using (l6^ that {r’fc.m} satisfies fhe consfrainfs of problem (l56l) wifh 
equality. Since 7 ^. m = 2‘‘k — I, m = 1,2, ... ,dk, Vfc, we have 

log det(I + llkVk,mVk,miik^k!m+l) 

= log det(l + (79) 

= logdet(l + 7 fc,m) = 

dk 

where we use the identity det(I + AB) = det(I + BA UlTTI in the first equality and (l64b in the second 
equality. By summing (17^ over m = 1,2,... ,dk, we obtain 

dk 

^ log det(I + ilkVk,mVk,miik'^k^rn+i) = det(I + HfcVfcVf = rk (80) 

m=l 

Combining (1781) . (l80l ). and together with A^ > 0 V/c, we concludes that {r’fc.m} and {A^} satisfy the 
KKT condition of problem (l56l) . ■ 
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IX. A Counter Example 

In the proof of Proposition |3l the assumption / 0, m = 2,3,..., A: E /C 

is used to obtain 2 = • • • = k £ fC, which finally leads to Part 1) of Proposition [3] 

Intuitively, it may hold that Afc,i = Xk ,2 = ■■■ = Xk,dk for the case when -/k^i = 7^,2 = • • • = 7fc,dfc, even 
if the assumption does not hold. However, it is worthy mentioning that, if the assumption is relaxed, 
there indeed exists some counter example as shown helow, where, Afc^i = Afc ,2 = • • • = /c E /C 

may not hold when 7^1 = jk ,2 = • • • = 7fc,(ifc> k & K. and as a result the KKT point {vk^m} of problem 
(l5^ is not a KKT point of problem (l56l) . 

Let us consider the special case—the point to point MIMO system with two streams. In this case, the 
rate-constrained power minimization problem (15^ boils down to 


minTr(VV^) 

V 

s.t. logdet(I + HVV^H) > r. 


( 81 ) 


With equal rate allocation for the two streams, the optimal solution to problem dST] ) can be found by 
solving the following problem 


mm ||Di 

Ui,U2,Vi,V2 


S.t. 


+ ll'*^2| 


U^(l + UV2V^li^)ui 


> 71, 


U^Ui 


> 72 


( 82 ) 


where 71 = 72 = — 1 . 

Let Ai and A 2 be the Lagrange multiplier associated with the first and second constraint of problem 
(l 8 ^ . respectively. In the following, we show that there may exist the case Ai / A 2 when 71 = 72 - The 


July 28, 2015 


DRAFT 




33 


KKT system of problem (1821) is given by 


I + Ylv2V^n^ - —) wi = 0 

I-ri2 = 0 

I - r>i = 0 


I + AiH^uiuf H - ^H"w2w"H ) ■i;2 = 0 


rtf (I + 

= 72 


72 
= 71 


|it2^Hr)2p 

U^U2 


•^1) A 2 > 0 


(83) 

(84) 

(85) 

( 86 ) 

(87) 

( 88 ) 

(89) 


For the special case, we relax the assumption, i.e., let = 0, which holds if vi and V 2 are 

two orthogonal eigenvectors of H^H. In the following, we let vi and r ;2 be two orthogonal eigenvectors 
of H^H, such that n|^H^Hr ;2 = 72 and (l + Ht; 2 '*i 2 ^H^) ^ Hrii = 71 . Hence, we have 

= pitii and H^Hr72 = ^ 2^2 where /xi and p 2 are the two corresponding eigenvalues of 
H^H. Furthermore, we let 


Ui = 


and 


: ^-(I + Hr;2n2^H^) 

VI + 71 

(90) 


(91) 

Ai- ^ + and A 2 - ^ + 

(92) 


/Ul /U2 

Now we are ready to show that {ui,Vi,U 2 ,V 2 , Ai, A 2 ) defined above satisfies fhe KKT system (I83II891) . 
Let us start with examining (1831) and ([84l) . First, since r;^H^Hi ;2 = 0, we have (l + ^ Hr;i = 

Hrii- Thus, 

1 

ui = -^===H.vi, 


VI + 71 ’ 

which is clearly orthogonal to U 2 and Hr )2 due to v^'ii^Ylv 2 = 0. It follows that 


(93) 


I + Hn2'uf - —HiJi-uf H" ) Ui 


1 


HvH 


71 


1 


1 


=Ui 


Hrii-uf (I + Hn2'uf H^) ^ Hn 


VI + 7i 7i 

=ui - ^ Hr>i = 0 

VI + 71 


(94) 
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where the first equality is due to = 0 and (l90l ). the second equality is due to 

(I + = 71 , and the last equality is due to (l9^ . Thus, ([83]) follows. Similarly, 

we can verify that U 2 and V 2 satisfy (l84l ). 

Next let us check (ISSl) and ([ 86 ]). First, due to ([90] ) and (l + ^ Ht;i = 71 , we 

have It follows that 

= (95) 

VI + 71 

= vi -= 0 

1 + 7i 

where the second equality is due to ([93]) and the last equality follows from Ai = and = 

Thus, ([85] ) follows. Similarly we can verify ([ 8 ^ . 

Finally, it is easy to verify that ([87]) . ([ 88 ]), and ([89] ) hold true for the defined (ui, tii, U 2 , ^ 2 , Ai, A 2 ). 
Now we are ready fo draw fhe conclusion. From ([9^ . if is readily known fhat, when H^H has fwo 
different eigenvalues ni and H 2 , we have Ai V A 2 even if 71 = 72 . 
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